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Abstract 

We present a single, common tool to strictly subsume all known cases of polynomial time 
blackbox polynomial identity testing (PIT) that have been hitherto solved using diverse tools 
and techniques. In particular, we show that polynomial time hitting-set generators for identity 
testing of the two seemingly different and well studied models - depth-3 circuits with bounded 
top fanin, and constant-depth constant-read multilinear formulas - can be constructed using one 
common algebraic-geometry theme: Jacobian captures algebraic independence. By exploiting 
the Jacobian, we design the first efficient hitting-set generators for broad generalizations of the 
above-mentioned models, namely: 

• depth-3 (Ens) circuits with constant transcendence degree of the polynomials computed 
by the product gates {no bounded top fanin restriction), and 

• constant-depth constant- occwr formulas {no multilinear restriction). 

Constant- occur of a variable, as we define it, is a much more general concept than constant- 
read. Also, earlier work on the latter model assumed that the formula is multilinear. Thus, our 
work goes further beyond the results obtained by Saxena & Seshadhri (STOC 2011), Saraf & 
Volkovich (STOC 2011), Anderson et al. (CCC 2011), Beecken et al. (ICALP 2011) and Grenet 
et al. (FSTTCS 2011), and brings them under one unifying technique. 

In addition, using the same Jacobian based approach, we prove exponential lower bounds for 
the immanant (which includes permanent and determinant) on the same depth-3 and depth-4 
models for which we give efficient PIT algorithms. Our results reinforce the intimate connection 
between identity testing and lower bounds by exhibiting a concrete mathematical tool - the 
Jacobian - that is equally effective in solving both the problems on certain interesting and 
previously well-investigated (but not well understood) models of computation. 

1 Introduction 

A polynomial in many variables, when written down verbosely as a sum of monomials, might have a 
humongous expression. Arithmetic circuits, on the other hand, provide a succinct way to represent 
multivariate polynomials. An arithmetic circuit, consisting of addition (-I-) and multiplication (x) 
gates, takes several variables as input and outputs a polynomial in those variables. The study of 
arithmetic circuits - as to which algorithmic questions on polynomials can be resolved efficiently 
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in this model of computation, and which polynomials do not admit any polynomial-sized circuit 
representation - form the foundation of algebraic complexity theory. 

One particular algorithmic question, the problem of polynomial identity testing (PIT), occupies 
a pivotal position in the theory of arithmetic circuit complexity. It is the problem of deciding if 
the output of a given arithmetic circuit is an identically zero polynomial. Being such an elemen- 
tary problem, identity testing has enjoyed its status of prime importance by appearing in several 
fundamental results including primality testing [AKS04| . the PCP theorem [ALM"'"98 and the 



IP = PS PACE result [LFKNQOt IShaOOj . among many others like graph matching |Lov79l[MVV87] . 
polynomial interpolation [CDGKOT] . matrix completion [IKS 10] . polynomial solvability |KY08) . fac- 
torization |SV10] and learning of arithmetic circuits |KS06| . What is more intriguing is that there is 
an intimate connection between identity testing and lower bounds jK I03l iHSSOt lAvMlO] . especially 
the problem of separating the complexity classes VP from VNP (which must necessarily be shown 
before showing P 7^ NP |Val79[ ISV85] ). Proving VP ^ VNP amounts to showing that an explicit 
class of polynomials, like the Permanent, cannot be represented by polynomial-sized arithmetic 
circuits, which in turn would follow if identity testing can be derandomized using a certain kind 
of pseudo-random generator |Agr05 , IKI03j . (Note that identity testing has a simple and efficient 



randomized algorithm - pick a random point and evaluate the circuit at it |Sch80[ Zip79 lDL78j .) 



During the past decade, the quest for derandomization of PIT has yielded several results on 
restricted models of circuits. But, fortunately, the search has been made more focussed by a 
result |AV081 IVSBR83] which states that a polynomial time blackbox derandomization of identity 
testing for depth-4 circuits (via a certainpseudo-random generator) implies a quasi-polynomial time 
derandomization of PIT for poly-degree^ circuits. By polynomial time blackbox test, we mean: 
A polynomial time hitting-set generator, which is a boolean Turing machine that pro- 
duces a set of points with small integer coordinates. These points are then fed (one by 
one) into the circuit, which internally uses any arithmetic, to output the evaluations 
of the polynomial at those points. (For small characteristic p, one works with a field 
extension, where each coordinate of a point is a small vector of integers in {0, 1}.) 
With depth-4 as the final frontier, the results that have been achieved so far include polynomial 
time hitting-set generators for the following models: 

• depth-2 (Sn) circuits (equivalently, the class of sparse polynomials) [KSOl] . 

• depth-3 (SnS) circuits with constant top fanin |SS11| . 

• depth-4 (Ensn) multilinear circuits with constant top fanin [SVllj . 

• constant-depth constant-read multilinear formulas |AvMVllj (& sparse-substituted variants), 

• circuits generated by sparse polynomials with constant transcendence degree |BMSlla] . 

To our knowledge, these are the only instances for which polynomial time hitting-set generators are 
known. The result on depth-3 bounded top fanin circuits is based upon the Chinese Remaindering 
technique of |KS07] and the ideal-theoretic framework studied in [SSlOj . Their work followed after 
a sequence of developments in rank bound estimates |DS05t IKS08t ISS091 IKS091 ISSlOj . some using 
incidence geometry - although, this result [SSll] in particular is not rank based. On the other hand, 
the work on constant-depth multilinear formulas [AvMVlTt ISVll] is obtained by building upon 
and extending the techniques of other earlier results [KMSVlOl ISV091 ISV08| on 'read-once' models. 
At a high level, this involved a study of the structure of multilinear formulas under the application 
of partial derivatives with respect to a carefully chosen set of variables and invoking depth-3 rank 



^Circuits computing polynomials with degree bounded by a polynomial function in the size of the circuit. 



2 



bounds (cf. jSYlOj for details). More recently, a third technique has emerged in [BMSlla] which 
is based upon the concept of algebraic independence of polynomials. They showed that for any 
given poly-degree circuit C and sparse polynomials fi, . . . , fm with constant transcendence degree, 
a hitting-set generator for C(/i, . . . , fm) can be constructed in polynomial time. 

Our contribution - With these diverse techniques floating around the study of hitting-set 
generators, one wonders: Could there be one single tool that is sufficiently powerful to capture all 
these models? Is there any unique feature underlying these seemingly different models that can lend 
itself to the conception of such a unifying tool? The answer to both these questions, as we show in 
this work, is yes. The key to this lies in studying the properties of the Jacobian, a mathematical 
object lying at the very core of algebraic independence. And as for the 'unique feature', notice 
that in the above four models some parameter of the circuit is bounded - be it bounded top fanin, 
bounded read of variables, or bounded transcendence degree. (Bounded depth should not be seen 
as an extra restriction on the circuit model because of |AV08j ) . At an intuitive level, it seems to us 
that it is this 'bounded parameter '-ness of the circuit that makes the Jacobian perform at its best. 

In the process of finding a universal technique, we strengthen the earlier results significantly. 
We construct hitting-set generators not only for depth-3 circuits with bounded top fanin, but 
also for circuits of the form C{Ti, . . . ,Tm), where C is a poly-degree circuit and Ti, . . . ,Tm are 
products, of linear polynomials, with bounded transcendence degree. In case of depth-3 circuits, 
C(Ti, . . . ,Tm) is simply Ti + . . . + T^. Further, we remove the restriction of multilinearity totally 
from the constant-depth constant-read model and construct the first hitting-set generator for this 
class. The condition of constant-read is also replaced by the more general notion of constant- occur. 

At this point, one is faced with a natural question: how effective is this new tool in proving lower 
bounds? The intimate connection between efficient algorithms and lower bounds has recurrently 
appeared in various contexts |Willl[ [RajOSj IUma03l IPSZOOl ITWQT]. For arithmetic circuits, this 



link is provably tight [KI031 Agr05 IAV08] : Derandomizing identity testing is equivalent to proving 
circuit lower bounds. Which means, one might have to look for techniques that are powerful 
enough to handle the dual worlds of algorithm design and lower bounds with equal effectiveness - 
for e.g. the partial derivative technique has been used to prove lower bounds and identity testing 
(albeit non-blackbox) on restricted models (survey |CKWll| ): the t -conjecture is another such 
example [GKPSlT] . In this work, we demonstrate a third tool - the Jacobian - using which we 
prove exponential lower bounds for the immanant (which includes determinant and permanent) on 
the same depth-3 and depth-4 models for which we give efficient PIT algorithms. In particular, 
this includes depth-4 constant-occur formulas, depth-4 circuits with constant transcendence degree 
of the underlying sparse polynomials (which significantly generalizes the lower bound result in 
[GKPSll] ). and depth-3 circuits with constant transcendence degree of the polynomials computed 
by the product gates. To our knowledge, all these lower bounds are new and it is not known how 
to prove them using earlier techniques. (A gist of this paper is provided in Figure [H Section [6l) 

1.1 A tale of two PITs (& three lower bounds) 

A set of polynomials f = {/i, • • • , fm} C F[xi, • • • , x„] (in short, F[x]) is algebraically independent 
over F if there is no nonzero polynomial H € F[?/i, • • • , ym\ such that H{fi, • • • , fm) is identically 
zero. A maximal subset of f that is algebraically independent is a transcendence basis of f and the 
size of such a basis is the transcendence degreelo of f (denoted trdegjrf). Our first theorem states: 



^ Since algebraic independence satisfies the matroid property cf. [Oxl92] . transcendence degree is well-defined. 
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Theorem 1.1. Let C be a poly-degree circuit of size s and each ofTi, . . . , be a product of d linear 
polynomials in F[xi, . . . , x„] such that trdegjr {Ti, . . . , T^} <r. A hitting-set for C(Ti, . . . , T^) can 
be constructed in time polynomial in n and {sdY , assuming char(F) = or > d''' . 

If C is a single + gate, we get a hitting-set generator for depth-3 circuits with constant transcendence 
degree of the polynomials computed by the product gates (there is no restriction on top fanin) . 

Our second result uses the following generalization of read-k formulas (where every variable 
appears in at most k leaf nodes of the formula) to occur-k formulas. Two reasons behind this 
generalization are: One, to accommodate the power of exponentiation - if we take the e-th power 
of a read-k formula using a product gate, the 'read' of the resulting formula goes up to ek - we 
would like to avoid this superfluous blow up in read. Two, a read- A; formula has size 0{kn), which 
severely hinders its power of computation - for instance, determinant and permanent cannot even 
be expressed in this model when k is a constant |Kal85| . This calls for the following definition. 

Definition 1. An occur-A: formula is a rooted tree with internal gates labelled by + and xX (power- 
product gate). A xX gate, on inputs gi,---,gm with incoming edges labelled ei,...,em £ N, 
computes ■ ■ ■ g^ ■ At the leaves of this tree are depth-2 formulas computing sparse polynomials 
(leaf nodes ), where every variable occurs in at most k of these sparse polynomials. 

Size of a X A gate is defined as the integer (ei + • • • + e^) associated with its incoming edges, while 
size of a + gate is counted as one. Size of a leaf node is the size of the corresponding depth-2 
formula. With these conventions, size of an occur-A: formula is defined to be the total size of all 
its gates (and leaf nodes) plus the number of edges. Depth is defined to be the number of layers 
of + and xA gates plus 2 (the 'plus 2' accounts for the depth-2 formulas at the leaves). Thus, 
occur-A: is more relaxed than the traditional read-A; as it packs the "power of powering" (to borrow 
from jGKPSTT]), and the leaves are sparse polynomials (at most kn many) whose dependence on 
its variables is arbitrary. E.g. (x'^X2 + xfxg -|- xix^Y is not read-1 but is trivially depth-3 occur-1. 

Theorem 1.2. A hitting-set for a depth-D occur-k formula of size s can be constructed in time 
polynomial in s^, where R = {2k)'^^'^ (assuming char(F) = or > s^). 

A tighter analysis for depth-4 occur-A: formulas yields a better time complexity. Note that 
a depth-4 occur-A; formula allows unbounded top fanin. Also, it can be easily seen to subsume 
Ensn(A:) multilinear circuits studied by (WTTl iKMSViO] . 

Theorem 1.3. A hitting-set for a depth-A occur-k formula of size s can be constructed in time 
polynomial in s^ (assuming char(F) = or > s"^^). 

For constant-depth, the above theorems not only remove the restriction of multilinearity (and 
relax read-A; to occur-A;), but further improve upon the time complexity of [AvMVllj and [SVll]. 
The hitting-set generator of [AvMVlT] works in time n'^'^''' ^+0(kD)^ which is super-exponential 
when k = ri(s^/^^'^ ) for any positive e <1 and a constant D, whereas the generator in Theorem 
11.21 runs in sub-exponential time for the same choice of parameters. The running time of |SV11| is 
gO{k ) ^ -v^^JiicJi is slightly worse than that of Theorem 11.31 

Since any polynomial has an exponential-sized depth-2, occur-1 formula (just the sparse repre- 
sentation), proving lower bounds on this model is an interesting proposition in its own right. 

Definition 2. \LR34^ For any character ^ ; — )- the immanant of a matrix IvI — (^ij)nxn 
with respect to x is defined as Imm^{M) = J2aeSn xi'^) IlILi 

Determinant &: permanent are special cases of the immanant with x as the alternating sign character 
& the identity character, respectively. Denote Imm^(M) by Imm„ for an arbitrarily fixed x- 



4 



Theorem 1.4. Any depth-A occur-k formula that computes Imm^ must have size s = 2^("'/'^ ) over 
any field of characteristic zero (even counting each xA gate as size one). 

Thus, if each variable occurs in at most nV2-£ (0 < e < 1/2) many underlying sparse polynomials, 
it takes an exponential sized depth-4 circuit to compute Imm„. Our next result is an exponential 
lower bound on the model for which hitting-set was developed in [BMSllaj (but no lower bound 
was shown). It is also an improvement over the result obtained in [GKPSll] which holds only for 
more restricted depth-4 circuits over reals. 

Theorem 1.5. Let C he any circuit. Let fi,...,fm be sparse polynomials (of any degree) with 
sparsity bounded by s and their trdeg bounded by r. If C{fi, . . . , fm) computes Imnin then s = 
2^{n/T) gy^jr. g^j^y fl^id qJ charactcristic zero. 

Which means, any circuit involving fewer than n^^"^ Sll-polynomials at the last levels, must have 
exponential size to compute Imm„. (The models of Theorem 11.41 &: 11.51 are incomparable). The 
next result is on the model for which hitting-set is given by Theorem ll.il 

Theorem 1.6. Let C be any circuit and Ti, . . . , be products of linear polynomials. If C{Ti, . . . , 
Tm) computes Imnin then trdegp {Ti, . . . ,Tm} = ri(n) over any field of characteristic zero. 

Which means, any circuit involving 0(71) nXj-polynomials at the last levels cannot compute Imm^. 
1.2 Our ideas 

The exact reasons why our techniques work, where older ones failed, are extremely technical. 
However, we now give the motivating, but imprecise, ideas. To a set of products of sparse poly- 
nomials {Ti, . . . ,Tm} we associate a polynomial - the Jacobian J{Ti, . . . ,Tr). It captures the 
algebraic independence of Ti, . . . , T,. (assuming this to be a transcendence basis of the Tj's). If we 
could find an r-variate linear map f that keeps o J{Ti, . . . , Tj.) nonzero, then ^p{Ti), . . . , ip{Tr) 
are again algebraically independent and it can be shown that for any C: C(Ti, . . . ,Tm) = iff 
C{ip{Ti), . . . , (p{Tm)) = 0. Since Tj's are not sparse, the Jacobian is usually a difficult polynomial 
to work with, and so is finding (/?. However, for the special models in this paper we are able to 
design ip - mainly because Jacobian (being defined via partial derivatives) has a nice 'linearizing 
effect', on the circuit product gates, that factors itself. The f ultimately provides a hitting-set for 
, Tm), as we reduce to a situation where r is constant. 
The initial idea for lower bounds is similar. Suppose Imm„ = C(Ti, . . . , Tm). Then, by algebraic 
dependence, J(Imm„,Ti, . . . ,T,.) = 0. Our proofs then exploit the nature of this identity for the 
special models. This part requires proving several combinatorial properties of the immanant. 

2 Preliminaries: Jacobian and faithful homomorphisms 

Our contribution, in this section, is an elementary proof of Theorem l2.lt which was originally proved 
in [BMSlla] using Krull's Hauptidealsatz. Here, we state the main properties of the Jacobian and 
faithful homomorphisms without proofs - for details, refer to [BMSllb] (or Appendix lA.ip . 

Definition 3. The Jacobian of polynomials f = {/i, • • • , fm} in F[xi, • • • , x„] is the matrix c7x(f) = 
{dxjfi)mxn, where dx^fi = dfi/dxj. Let 5 C x = {xi, . . . , Xn} and \S\ = m. Then Jsi^) denote 
the minor of J^x{f) formed by the columns corresponding to the variables in S. 

Fact 1 (Jacobian criterion). Let f C F[x] be a finite set of polynomials of degree at most d, and 
trdegjrf < r. //char(F) = or char(F) > , then trdegpf = rank]p-(x)^x(f)- 
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Fact 2 (Chain rule). For any finite set of polynomials f C F[x] and a homomorphism $ : F[x] —?■ 
¥[y], we have Jy($(f)) = $ (Jx(f)) • Jy(^(x)). 

Definition 4. A homomorphism ^ : F[x] —?■ F[y] (y is another set of variables) is said to be 
faithful to a finite set of polynomials f C F[x] i/trdegpf = trdegp <I>(f). 

Theorem 2.1 (Faithful is useful). Let f = {/i, • • • , f^} C F[x] and ^ be a homomorphism faithful 
to f. For any polynomial C G ¥[yi, ■ ■ ■ ,ym], C(f) = <^ (7(<i>(f)) = 0. 

Lemma 2.2 (Vandermonde is faithful). Let f C F[x] be a finite set of polynomials of degree at 
most d, trdegp f < r, and char(F) = or > d'' . Let ^ : F[x] — )• F[z] be a homomorphism such that 
rankF(x)jrx(f) = rank]j-(2.)*( Jx(f))- 

Then, the map $ : F[x] F[z, t,yi, . . . ,yr] that maps, for all i, Xi (^Yl^j=i ^j^'"') + ^i^i) ^■^ 
a homomorphism faithful to f . 

The proof of the above lemma is based upon Facts [H [2] and an application of 'rank preserving' 
linear maps |GR05] . See Appendix lA.il 

3 Hitting-set for constant transcendence degree depth-3 circuits 

Let C be any circuit and D be the circuit C{Ti, ■ ■ ■ ,Tm), where each Tj is of the form 11^=1 
every iij is a linear polynomial in F[xi, . . . , Xn]- Denote by T the set {Ti, . . . , T^} and by L(Tj) the 
multiset of linear polynomials that constitute Tj. Suppose trdegjr T = k < r and T^ = {Ti, . . . , T^} 
be a transcendence basis of T. Since i7x(Tfc) has full rank (char(F) = or char(F) > d^), without 
loss of generality assume that the columns corresponding to x^ = {xi, • • • , x^} form a nonzero kxk 
minor of i7x(Tfc). By Lemma 12.21 if we construct a ^ : F[x] — )• F[z] that keeps Jxfe(Tfc) nonzero 
then ^ can easily be extended to a homomorphism <I> : F[x] ¥[z,t,yi, . . . ,yr] that is faithful to 
T. And hence, by Theorem 12.11 it would follow that ^{D) = if and only if D = 0. 

If Ti = YYj=i ^ij then dxTi = Ti ■ (^Yl'j=i 9x^ij/^ij^ ■ By expanding, using this additive structure 
of dxTi and the linearity of determinant wrt rows, the determinant Jxj.(Tfc) takes the following 
form, 

Jx,(T,)= yT^-'^x,(4,--- ,4). (1) 

^ieL{Ti),...,4-eL(Tfe) ^ ^ 
Call a set of linear polynomials independent if the correponding homogenous linear parts (i.e. the 
constant-free parts) are F-linearly independent. The term Jxfc(^i,-- - ,4) ensures that the above 
sum is only over those ii, - ■ ■ ,ik that are independent linear polynomials (otherwise the Jacobian 
vanishes). The sum has the form of a depth-3 circuit, call it Hq, and we intend to construct a 
low-variate ^ such that ^{Hq) ^ 0. We show that this is achieved by a ^' that preserves the 
independence of a 'small' set of linear polynomials - which we call a certificate of Hq. 

Certificate of Hq: We can assume that the terms Jyi^{ii-,- ■ ■ ,ik) in equation ([T|) are nonzero 
field constants. Let C{Hq) be the set of all linear polynomials occurring in the denominator terms 
"£i • • -4" of all the summands in sum ([T|). By adjusting the field constants at the numerators, 
we can assume that no two linear polynomials in C{Hq) are constant multiple of each other. This 
means, the depth-3 circuit Hq has the form Hq = T ■ Y^j^ OL^jlx • • • 4, where T := Hi^i ^fe, ol is a 
nonzero field constant and the sum runs over some sets L = {ii, ■ ■ ■ , ik} oi k independent linear 
polynomials in C{Hq). Define, content of a depth-3 circuit G = X^j-Pj, where Pi is a product of 
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linear polynomials, as cont(G) := gcdjjPi}, and let the simple part sim(G) := G/cont(G). Hence 
cont(Fo) = gcd^{r/£i • • • 4} and 

OL ^ T 



sim(Fo) = -^0 • > 7 ^, where Fq = -tttT' (2) 

^«i---4 cont(iio) 

Note that, since i G C{Hq) iff £| |Fo, Fq is simply the product of the linear polynomials in C{Hq) 
and so deg(Fo) = \C{Hq)\. For any i € C{Hq), the terms in sim(ffo) that survive modulo £ are 
those with £ in the denominator "^i • • • 4" of the above expression. Hence, Hi := sim(i?o) mod ii = 
Fq/^i ■ 1^£2 ■■■ • • • 4- We can treat Hi as a depth-3 circuit in one less variable: Suppose 

that £i = cixi + Y17=2 ^i^i where q's G F and ci 7^ 0, then we can replace xi by — Y17=2 Ci^j/ci 
in sim(i?o)) particularly in Fq/£i (of course, after dividing Fq by £1) as well as in each of £2, ■ ■ ■ ,£k 
in the denominators, so that Hi becomes a depth-3 circuit in F[a;2, ■ ■ ■ ,Xn]- Therefore, it makes 
perfect sense to talk about cont(ifi) and sim(f/'i). Observe that £2,-" )4 remain independent 
linear polynomials modulo £1, and so Hi is a depth-3 circuit of the 'same nature' as Hq but with 
one less linear polynomials in the denominators. Also, the linear polynomials in C{Hi) is a subset 
of the linear polynomials in C{Hq) modulo £1. Extending the above argument, it is possible to 
define a sequence of circuits: Hi := sim(ffj_i) mod £i, {1 < i < k) where £i G C{Hi-i). Further, 
C{Hi) is a subset of C{Hi-i) modulo £i, which implies that essentially there are independent 
linear polynomials, say ^1, . . . ,£k, in C{Hq) such that £i = £i mod (^1, . . . ,£i-i) and therefore Hi = 
sim(i7j_i) mod (£1, . . . 

Lemma 3.1 (Certifying path). There exists independent linear polynomials {^i,--- ,£k} ^ C,{Hq) 
such that Hi ^ mod (^1, . . . ,£i), Mi G [k], and Hk is a nonzero product of linear polynomials in 
C{Hq) modulo {£i,--- ,4)- 
Proof: Induction on k, see Appendix IA.21 

A set {£1 , . . . ,£k}, satisfying Lemma 13. !( is called a certifying path of Hq . Fix a certifying 
path {^i,--- ,4}- Let ^ : F[x] ¥[zi, . . . , z^+i] be such that ^'(^i), . . . , ^'(4) are indepen- 
dent linear polynomials in F[z] and for every £ G U^^]^L(Tj), £ 7^ mod (£1, . . . ,£k) iff ^{£) 7^ 
mod (^'(^i), . . . , ^'(4))- We call such a a rank-{k + 1) preserving map for Hq. It can be shown 
that one of the maps : Xj 1-^ Si=i ■^i^*"'' where b runs over dkn{k + 1)^ distinct elements of F, 
is a rank-(A: -|- 1) preserving map for Hq. (It is a simple application of |GR05j . See Corollary IA.2p . 

Theorem 3.2 (Certificate). // ^ : F[x] F[zi, Zfc+i] is a rank-{k + 1) preserving map for Hq, 
then "^{Hq) ^ 0. 

Proof: Reverse induction on k, see Appendix lA. 21 

Proof of Theorem As r > k, we can assume that the rank-(/c -|- 1) preserving map ^ is 

in fact a map from F[x] — )• F[zi, . . . ,2:^+1] • Therefore, by Lemma l2.2|, <!• is a map from F[x] — )• 
^[yi, ■ ■ ■ yr,t, zi, . . . , Zr+i] such that: D = iS ^{D) = 0. Since C is a poly-degree circuit of size s, 
^{C{Ti, . . . , Tm)) is a polynomial of degree at most ds^^^^ resp. nrds^^^^ in the variables y, z resp. 
t. Using [SchSOl Zip 79 lDL78j lemma, we can construct a hitting-set for $(-D) in time polynomial 



in n{sdY . Since construction of ^ takes time po\)/{ndr), the total time taken is poly(n, {sdY). □ 

4 Hitting-set for constant-depth constant-occur formulas 

Bounding the top fanin - Let C belong to the class C of depth-D occur-fc formulas of size 
s. Observe that if C(xi, . . . ,Xn) is non-constant and nonzero, then there is an i such that C := 
C(xi, • • • , Xi-i,Xi + 1, Xj+i, • • • , Xn) — C{xi, • • • , Xn) 7^ 0, assumiug char(F) > s^ (i.e. the bound 
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on the degree of C). If C has a + gate on top then C(x) = Xll^i where Tj's are computed by 
xX gates at the next level. Since occurs in at most k of the Tj's, C has top fanin at most 2k. If 
C has a X A gate on top then C has a + gate on top with fanin 2 and depth(C') = D + 1. Therefore, 
C belongs to the class C of depth- (£) + 1) occur-2A; formulas of size at most (s^ + s), and a + gate on 
top with fanin bounded by 2k. Suppose is a hitting-set for the class C. Form a new setHDV. by 
including points (ai + 1, 0:2, . . . , an), (ai, 0:2 + 1, . . . , On), • • • , • • • , an-i, a™ + 1) in for every 
(ai, 02, • • • , On) G "H. Observe that 'H is a hitting-set for C and size('H) = n ■ size(7^). Therefore, it 
is sufficient if we construct "H. By reusing symbols, assume that C is a depth- occur-/c formula of 
size s with a + gate on top having top fanin at most k. 

Let C(x) = J2i=i ^i- The goal is to construct a <I> that is faithful to T = {Ti, . . . ,Tfc}. Let 
= {Ti, . . . ,Tr} be a transcendence basis of T. Since jrx(Tj.) has full rank (char(F) = or 
> s^^), assume that the columns corresponding to x^ = {xi, . . . ,Xr} form a nonzero minor of 
^x(Tr). By Lemma \T2\ it suffices to construct a ^' that keeps Jxr(T.r) 7^ 0. 

Proof idea - Identify a gate with the polynomial it computes, and count level of a gate from the 
top - the gates Tj's are at level 2. Suppose each Tj is a x A gate and Tj = Y[e=i ^iT ^^ere Pi/^i 
are gates at level 3. Since Tj is also an occur-/c formula, xi, . . . ,2;^ appear in at most kr of the 
Pi/s, say . . . Pj^fcr- Hence, djTi = {Y{i=kr+iPiT^ ' (^J H^Ii -f^/'O for every 1 <i,j <r and 
therefore, Jx,(T,) = (HLi Htfcr+i ) " det(a, Hti ^^7)- Now notice that det(5,- n£i ) 
is a polynomial in Pj^^ and djPi^i, for 1 < i,j < r and 1 < ^ < A;r. (Note the irrelevance of the 
exponents ej^^'s.) So, if ^ is faithful to the set V := {Pi£,djPii ■ 1 < i,j < r,l < £ < kr} and 
the singleton sets {Pi/} for I < i < r , kr + I < £ < d, then ^'(Jx^(Tr)) 7^ 0. Observe that the 
polynomials in V and the singleton sets are (zeroth and first order) derivatives of the gates at 
level 3, and further these sets involve (the derivatives of) disjoint groups of level-3 gates. This 
disjointness feature ensures that the number of such sets is at most s. Thus, we have reduced the 
problem of constructing a faithful map $ for T (gates at level 2) to the problem of constructing 
a map ^ that is faithful to at most s many sets each containing derivatives of gates at the third 
level. Now, the idea is to carry forward this argument recursively to deeper levels: In the next 
level of the recursion we reduce the problem to constructing a map that is faithful to at most s sets 
containing (zeroth, first and second order) derivatives of disjoint groups of gates at level 4, and so 
on. Eventually, the recursion reaches the level of the sparse polynomials (the leaf nodes) where a 
faithful map can be constructed using ideas from [KSOlj . 

Let us formalize this proof idea. For any multiset of variables S, let A5/ denote the partial 
derivative of / with respect to the variables in S (including repetitions, as 5 is a multiset). Let 
var(5') denote the set of distinct variables in S. 

Lemma 4.1 (Gcd trick). Let G be any gate in C and Si, - ■ ■ ,5"^ be multisets of variables. Then 
there exists another occur-k formula G' for which, the vector of polynomials (Ag^G, • • • , As^G) = 
Vg • {As,G', • • • , As^G') such that 

1. If G is a + gate then G' is also a + gate whose children consist of at most k ■ |U^;^var(5i)| 
of the children of G, and Vg = 1 . 

2. If G is a XX gate, then G' is also a x A gate whose children consist of at most k- |U^;^var(5i)| 
of the children of G, and Vq = G/G' . 

Further, the gates constituting G' and Vq are disjoint. 

Proof: Use properties of derivation and occur-fc, see Appendix IA.3[ 
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We say that a map is faithful to a collection of sets if it is faithful to every set in the collection. 
Going by the 'proof idea', suppose at the i-th. level of the recursion we want to construct a ^£ 
that is faithful to a collection of (at most) s sets of polynomials, each set containing at most ri 
partial derivatives (of order up to q) of the gates at level i. Moreover, the sets involve derivatives 
of disjoint groups of gates. To begin with: £ = 2 and we wish to construct a ^'2 that is faithful to 
just one set T, so r2 < A; and C2 = 0. The next lemma captures the evolution of the recursion. 

Lemma 4.2 (Evolution via factoring). Let U be a set of ri derivatives (of orders up to ci) of gates 
Qu at level I, andW he a transcendence basis ofU. Any \U'\ x \U'\ minor of J:x,{U') is of the form 
WiV^ \ where Vi's are polynomials in at most r^+i := (q + 1) • ■ r^^ many derivatives (of 

order up to q+i := ci + \) of disjoint groups of children of Qu- 
Proof: Apply the gcd trick for each G G Qu, see Appendix IA.3I 

Let Ci denote the collection of sets for which we want to construct a faithful map at the ^-th level 
of the recursion. The collection Q+i is formed from Ci using the above lemma: 1^ is a polynomial 
in a set of derivatives of gates at the {£ + l)-th level - denote this set of derivatives by Elem(Vi) - 
then Q+i consists of the sets Elem(Vi) as U varies over all the sets in the collection C^. It follows 
from the lemma that the groups of gates whose derivatives form the different Elem(V^)'s are disjoint 
and therefore |C^+i| < s. Using Lemma 12.21 fc we can lift a map ^e-\-i to construct 



Corollary 4.3. // ^'f+i is faithful to Q+i then : Xj iH- [YlY=i Vj/ ' i^eY-'j + ^e+ii^i) is faithful 
to Ci, where {yi/, ■ ■ ■ , yn/, ti} is a fresh set of variables. 

Proof of Theorem ] 1. Si Unfolding the recursion, we eventually reach the level of the sparse polyno- 
mials at depth D — 2 and are required to construct a map that is faithful to a collection Cd-2 
of at most s sets of derivatives of sparse polynomials, each set containing at most r£)_2 elements. 
Using the relation between r^+i and from Lemma [4.2l it is easy to bound r/)_2 by i? = (2A;)^^'^ . 
Let U G Cd-2 with transcendence basis U'. Any \U'\ x \U'\ minor of i7x(Z^') is a sparse polynomial 
with sparsity bounded by s^ and degree bounded by sR. Using |KS01| . the nonzeroness of this 
determinant is maintained by one of the maps <I>p : Xj 1— > n*^**^"*"^^* """^ ^ as p varies from 1 to a fixed 
poly(s'^). Since |Cd-2| < s, one of the maps ^p, I < p < s ■ poly(s^), preserves the rank of the 
Jacobian of all U in Cd-2 - fix such a ^p. Finally, : Xi i->- X^jLi yj,D-2t^^_2 + ^pi^i) is faithful 
to Cd-2- Now lift this map ^d-2 to ^'2 that is faithful to T using Corollary 14.31 The map ^'2 
reduces the number of variables to 0{R) and hence an application of ^SchSOj Zip79 [DL78j lemma 



leads to a hitting-set generator with running time poly(s^). For the Jacobian criterion to work we 
need char(F) = or > s^. □ 

4.1 Restriction to the case of depth-4 

Proof of Theorem \1.3l Let C = Yli=i '^i be a depth-4 occur-A; formula, where Tj = 11^=1 ^ij^ ' 
Pjj 's are sparse polynomials. The discussion at the beginning of this section justifies the assumption 
that top fanin is k. Once again, assuming to be a transcendence basis of T, we need to design 
a ^' such that ^'(Jx^(Tr)) 7^ 0. Let us count the number of -Pij's that depend on the variables 
x^, the remaining P^J^'s can be taken out common from every row of JxrC^r) while computing its 
determinant - this is the first 'taking common' step. Let cn be the number of Pij^s present in Tj that 
depend on X£. The total number of sparse polynomials depending on is therefore Yli<i e<r'^ii- 
From the condition of occur-A;, < k and hence Ylie'^i(- — — Ylj'^ij, be 

the number of x^-dependent -Pij's present in Tj. For an x^-dependent Ptj, we can also take P^j 



ij 1 



9 



common from the i-th row of J^^rC^r) - call this the second 'taking common' step. The sparsity 
of every entry of the i-th row of the residual matrix M - after the two 'taking common' steps - is 
bounded by qs^S where s is the size of C. Thus, det(M) has sparsity at most ?"!-ni=i '^i^'^^ — ^'^^^ \ 
which implies that Jx^(Tr) is a product of at most s + 1 powers of sparse polynomials, each of 
whose sparsity is bounded by s'-'^'^ ^ and degree bounded by sk. As argued before, use |KS01] along 
with Lemma [2.2l to construct a hitting-set for C in time s'^^^ ^ (assuming char(F) = or > s^*^). □ 

5 Lower bounds for the immanant 

For convenience, we prove the lower bounds for Detn - determinant of an n x n matrix M = (xij) - 
assuming zero characteristic. All our arguments apply to Immj^(M) for any character x (Appendix 
lA.Sp . The following two lemmas are at the heart of our approach to proving lower bounds. Let 
X := {xij : 1 < i, j < n} and T := {Ti, . . . , Tm}, where Tj's are polynomials in F[x]. (See Appendix 
I A. 41 for the proofs.) 

Lemma 5.1. Suppose Det„, = C(Ti, . . . ,Tm), where C is any circuit and let = {Ti, . . . ,Tr} he 
a transcendence basis ofT with r < n. Then, there exist a set of r + 1 variables x^+i C x and an 
equation Yll=i ^ifi ' ~ ^ such that Mi 's are distinct first order principal minors of M , fi 's are 
distinct r x r minors of c7xr+i(Tr), not all fi 's are zero, and Ci € F*. 

Lemma 5.2. // Mi, • • • ,Mt are distinct first order principal minors of M and Yll=i fi ' ~ ^ 
(not all fi 's are zero) then the total sparsity of the fi 's is at least 2"/^~*. 

5.1 Lower bound on depth-4 occur-fc formulas 

Proof of Theorem ] 1.4\ Let C be a depth-4 occur-A; formula of size s that computes Det„. Since 
Det„ is irreducible we can assume a top + gate in C. Then C := C{xu + 1, xu, . . . , Xnn) — C{x) is 
a depth-4 occur-2A; formula of size at most and top fanin bounded by 2k (similar argument as 
at the beginning of Section Hj). Moreover, C computes the minor of M with respect to xu which 
is essentially Det„_i. By reusing symbols, assume that C is a depth-4 occur-A; formula with top 
fanin bounded by k, and C computes Det,i. 

Let C = X^JLi = L)et„, where Tj = Y['j=i'^ij^^ ^ij'^ sparse polynomials. Let be a 
transcendence basis of T = {Ti, . . . ,Tk}. By Lemma ISTTl we have an equation Yll=i ^ifi ' — 
such that /i's are distinct r x r minors of i7xr+i(Tr) for some set of r + 1 variables x^+i. Arguing in 
the same way as in the proof of Theorem 11.31 (in Section 14. ip , we can throw away certain common 
terms from the minors /j's and get another equation Yll=i 9i^h = 0, where the sparsity of each gi 
is s^^^^\ If we apply Lemma 15.21 on this equation, we get our desired result. □ 

5.2 Lower bound on circuits generated by Tli polynomials 

Proof of Theorem \1.5[ In Lemma [5. 11 take the Tj's to be sparse polynomials with sparsity bounded 
by s. Then, in the equation Cj/j • Mj = 0, each fi has sparsity s^^^\ Finally, apply Lemma [5. 2 1 

to obtain the desired lower bound. □ 

5.3 Lower bound on circuits generated by IIS polynomials 

Proof of Theorem \1.6[ Let T = {Ti,--- ,Tm} be products of linear polynomials such that 
C{Ti,--- ,Tm) = Detn with = {Ti,--- ,Tk} being a transcendence basis. By Lemma EH 
we get Yli=i '^ifi-^i — where the /j's are k x k minors of ^Xfc+i(Tfc) and wlog /i / 0. Like in 
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Section [3l we can rewrite this equation in the form Hq := T ■ J2l '^L(^k+i)/h • ■ ■ ^fc = where 
aL(Mfc+i) := Yli=i '^L,iMi is an F-Unear combination of M^+i := {Mi, • • • , M^^i}. Observe that 
Hq is a sum of products of hnear polynomials, with 'coefficients' being F-linear combinations of 
M,fc-i_i. And since /i 7^ 0, the 'coefficient' of Mi in Hq is a nonzero depth-3 circuit. 

The idea is to apply a similar treatment as in Section [3] to evolve Hq. The invariant that 
shall be maintained is that the coefficient of Mi (modulo some linear polynomials), which is a 
depth-3 circuit, would stay nonzero. This would finally yield a non-trivial linear combination 
aL(Mfc_|_i) = mod ik whence we can apply the following lemma. (See Appendix IA.4[ ) 

Lemma 5.3. If Mi,-- - ,Mt are distinct first order principal minors of M and Yll—iCtiMi = 
mod ik (not all ai = 0) for independent linear polynomials i^, then t + k > n. 



and define sim(iJ) := H/cont{H). Let sim(//o) have the form Fq aL(M.k+i)/h • • • ^k- The coef- 
ficient of Ml in the above expression is a nonzero depth-3 circuit, whose degree is \C{H())\ — k. There- 
fore by Chinese remaindering, 3ii € C{Hq) such that this coefficient is nonzero modulo ii. Hence, 
we can define Hi := sim(i/o) mod ii which has the form Hi = Fq/Ii ■ J^ls^i '^L{J^k+i) / ^2 ■ ■ ■ ^fc = 
mod ii. And like in Section[3l the above equation can be rewritten by replacing a variable occuring 
in ii by a suitable linear combination of the rest. Thus, we may write Hi = Fi a/,(Mfc+i mod 
^i)/^2 ■ ■ '^fc = 0, and maintaining the invariant that the coefficient of Mi mod ^1 is nonzero. Re- 
peating this argument, we eventually obtain H^ '■= Fk ■ aiij^k+i mod it) = while the coefficient 
of Ml mod t-k is nonzero. This implies that aL(Mfc-t-i) = mod ik is a non-trivial equation. And 
Lemma 15.31 asserts that this is not possible unless 2k + 1 > n k > [n — l)/2. □ 

6 Conclusion 

We would like to note that the proof technique used to show the lower bound for depth-4 occur-A; 
formulas can be extended to prove an exponential lower bound for constant-depth constant-occur 
formulas if the following conjecture is true (see Appendix [B] for details). 

'Determinant of immanants' conjecture: Let M = {xij) be an n x n matrix, and let Xi denote 
the i-th diagonal variable xa. Let M' be a projection of M by setting c = o(n) of the variables in 
M to constants. Suppose the elements := {xi, • • • ,Xk}, where A; is a constant independent of 
n, are partitioned into non-empty sets St := {Si, • • • , St}. Consider M.{St), the set of all t^^ order 
principal minors of M', each by choosing a t-tuple B G Si x ■ ■ ■ x St as pivots. Over all possible 
choices of B, we get m := \Si \ ■ ■ ■ \St\ many minors. Tlicn for ciny S6t of diajgonal va-riciblGS ym 
disjoint from x^, Jy„^ {M{St)) / 0. 

In (Jacobian) spirit, the conjecture states that the t*'^-order principal minors Nb^, ■ ■ ■ , Nb^ are 
algebraically independent, when n is sufficiently large (say, n > c + k + m). 

Spurred by the success of Jacobian in solving the hitting-set problem for constant-trdeg depth-3 
circuits and constant- occur constant-depth formulas, one is naturally inspired to investigate the 
strength of this approach against other 'constant parameter' models - the foremost of which is 
constant top fanin depth-4 circuits (PIT even for fanin 2?). 

Another problem, which is closely related to hitting-sets and lower bounds, is reconstruction of 
arithmetic circuits [SYlOl Chapter 5]. There is a quasi-polynomial time reconstruction algorithm 
|KS09] ■ for a polynomial computed by a depth-3 constant top fanin circuit, that outputs a depth- 
3 circuit with quasi-polynomial top fanin. Could Jacobian be used as an effective tool to solve 
reconstruction problems? If yes, then it would further reinforce the versatility of this tool. 



Formally, define the content of a circuit H = T aL{'M.k+i)/ii - - - ik as cont(-?/) := gcd^ 
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Figure 1: Comparison with the earher efficient hitting-sets 
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A Missing Proofs 

A.l Preliminaries: Jacobian and faithful homomorphisms 

Theorem 12.11 (restated). Let f = {/i, • • • , /„} C F[x] and ^ he a homomorphism faithful to f . 
For any polynomial C G ¥[yi, ■■■ , y^], C(f) = <^ C(<I>(f)) = 0. 

Proof. Since is faithful to f, there is a transcendence basis (say, fi,...,fs) of f such that 
<I>(/i), . . . , <I>(/s) is a transcendence basis of ^*(f). The function field K = F(f) essentially con- 
sists of elements that are polynomials in fs+i, . . . , fm with coefficients from F(/i, . . . , fg). Treating 
C(f ) as a nonzero element of K, there is an inverse Q G IK such that Q-C = 1. Since Q is a polyno- 
mial in fs+i, ■ ■ ■ , fm with coefficients from F(/i, . . . , fg), by clearing off the denominators of these 
coefficients in Q, we get an equation Q ■ C = P{fi, . . . , fs), where Q is a nonzero polynomial in f 
and P is a nonzero polynomial in /i, . . . , /g. Applying $ to both sides of the equation, we conclude 
that C($(f)) = $(C(f)) / 0, otherwise P($(/i), . . . , $(/«)) = $(P(/i, ...,/.)) = which is not 
possible as <I>(/i ),..., <I>(/s) are algebraically independent and P is a nontrivial polynomial. □ 

Lemma A.l (Vandermonde map). Let A be a r x n matrix with entries in a field ¥, and let t be 
an indeterminate. Then, rank]ir(j) (^A ■ {f^)i^[n],j£[r]) = rankp^. 

Proof. Follows from Lemma 6.1 of [GR05] . □ 

Corollary A. 2. Let Vi, ■ ■ ■ ,Vt he k-dimensional suhspaces of linear polynomials in F[xi, • • • , 
For a constant a G F, define the following linear homomorphism o,s 

k 

i=i 

// [F| > tnk"^ , then there exists an a such that '^a is an isomorphism on each of Vi, - ■ ■ ,Vt. 
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Lemma 12.21 (restated). Let f C F[x] be a finite set of polynomials of degree at most d, trdegp f < 
r, and char(F) = or > d^ . Let ^ : F[x] F[z] he a homomorphism such that rankF(x)iTx(f) = 
rankF(,)*(Jx(f)). 

Then, the map $ : F[x] — )■ F[z, t,yi, . . . ,yr] that maps, for all i, Xi (Yl^j=i ^j**"') + ^i^i) ^•^ 
a homomorphism faithful to f . 

Proof. Wlog let trdegjff = r, which then (by Jacobian criterion) is the rank of J7x(f). We intend 
to show that the matrix J'y{^({)) is of rank r, which would imply (by Jacobian criterion) that 

trdegir(t,z) ^(f) = r. 

Consider the projection J'' of J7y($(f)) obtained by setting yi = • • • = ?/r = 0. 

J'=[Jyim)]y=o = [^(^x(f))-^y(<J>(x))]y^o (By chain rule) 
= M/(Jx(f)). Jy(<I>(x)) 

Observe that the matrix ^y(<I>(x)) is exactly the Vandermonde matrix that is present in Lemma fA.ll 
Also, ^'(^x(f)) has entries in F(z), and by assumption has the same rank as J^^i^)- Hence, by 
Lemma lA.l^ 

rankiF(j,,) J' = rankF(j,,) (^(Jx(f)) • Jy(^(x))) = rankF(,)^( Jx(f)) = r. 

And since J'' is just a projection of J^y{^{{)), the rank of the latter must also be r. Hence, $ is 
indeed faithful. □ 



A. 2 Hitting-set for constant transcendence degree depth-3 circuits 

Lemma 13.11 (restated). There exists independent linear polynomials {^i,--- ,£k} ^ C{Hq) such 
that Hi mod (ii, . . . , £i). Mi S [k], and is a nonzero product of linear polynomials in C{Hq) 
modulo (^1, • • • ,ik)- 

Proof. The proof is by induction on k and follows the sketch given while defining sim(-). The 
degree of the nonzero polynomial sim(/7o) is |>C(-ffo)| ~ ^- Hy Chinese remaindering, there exists 
an ii S J~-{Hq) such that Hi := sim(//o) mod £i 7^ 0. In the base case {k = 1), it is easy to 
see that Hi is a nonzero product of linear polynomials modulo ii. For any larger k, the depth-3 
polynomial Hi has exactly the same form as Hq but with k — 1 independent linear polynomials in 
the denominators. Induct on this smaller value k — 1, keeping in mind that C{Hi) C C{Hq) modulo 

Let Zi and denote the ideals generated by {ii, . . . ,ii} and {^'(^i), . . . , ^'(£j)}, respectively. 

A rank-(A; + 1) preserving ^ satisfies: i ^ modXj iff ^{i) ^ mod ^'(Xj), for all 1 < i < k and 

^GuiiL(r,). 

Theorem 13.21 (restated). // ^ : F[x] — )• F[zi, Zk+i] is a rank-{k + 1) preserving map for Hq, 
then *(Fo) / 0. 

Proof. Let {ii, . . . ,lk} be the certifying path of Hq fixed above. The proof is by reverse induction 
on k: Assuming ^{Hi) / mod *(Ii), we show that ^{Hi^i) / mod *(Xj_i) for A: > z > 2. 
The base case: By Lemma l3.ll Hi^. is a nonzero product of linear polynomials in C{Hq) modulo 
Xfc, so by the definition of a rank-(A; + 1) preserving map, ^{H^) 7^ mod ^{Tk) (ideal generated 
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by independent linear polynomials is an integral domain). By construction, Hi^i = cont(i?j_i) • 
sim(i/j_i) = cont(-ffj_i) • [qiii + Hi] mod for some polynomial qi. Which means, = 

^(cont(F,_i)) • [^{qi)^{£i) + ^{Hi)] mod If [^{qi)^{ii) + ^{Hi)] = mod ^{li^i), then 

"^{Hi) = mod ^(Xi) which contradicts the induction hypothesis. Also, by Lemma IXTl Hi^i ^ 
mod implying that cont(ffj_i) ^ Omodlj-i. Since, i > 2, the linear polynomials in the 
term cont(-?/i_i) belong to C{Hq) modulo the ideal once again by using the rank-(A; + 1) 

preserving property of ^, we infer that ^(cont(/7j_i)) ^ mod Therefore, 7^ 

mod ^'(2j_i). Finally, to obtain "^{Hq) 7^ from ^'(-ffi) 7^ mod ^'(Xi), use the same argument 
as above and that ^(i) / for every £ G u'^^-^L{Ti). □ 

A. 3 Hitting-set for constant-depth constant-occur formulas 

Lemma 14.11 (restated). Let G he any gate in C and Si, - ■ ■ ,3^ be multisets of variables. Then 
there exists another occur-k formula G' for which, the vector of polynomials (A^^G, • • • , As^G) = 
Vg-{As,G',--- ,As^G') such that 

1. If G is a + gate then G' is also a + gate whose children consist of at most k ■ \Uf^ivaic{Si)\ 
of the children of G, and Vg = 1 • 

2. IfGisaxX gate, then G' is also a xX gate whose children consist of at most A:- |U^;^var(S'j)| 
of the children of G, and Vq = G/G' . 

Further, the gates constituting G' and Vg are disjoint. 

Proof. 1. Suppose G = Hi + ■ ■ ■ + Hm- Then at most A; • | U var(5j)| of its children depend on 
the variables present in Uvar(Sj); let G' be the sum of these children. Then, Asfi = A5.G' 
as the other gates are independent of the variables in USi. 

2. Suppose G = H^^ ■ ■ ■ H^ . Since G is a gate in an occur-/c formula, at most A: • | U var(5i)| 
of the HiS depend on the variables in US'^; call these Hi, ■ ■ ■ , Ht. Let G' := H'^^ ■ ■ ■ H^^ and 
Vg := G/G'. Then, As^G = Vg ■ Asfi' as claimed. □ 

Lemma 14.21 (restated). LetU he a set of r^ derivatives (of orders up to ci) of gates Qu at level 
i, and W he a transcendence basis oflA. Any \IA'\ x \hl'\ minor of Jyi{U') is of the form Y\i 
where Vi 's are polynomials in at most r^j^i := (ci + 1) • 2'^''^^k ■ r^^ many derivatives (of order up to 
:= C£ + 1) of disjoint groups of children of Qu. 

Proof. Let G & Quhe & gate at level I and {Ui,. . . , Usq} C W be the set of all the derivatives of G 
present in W . Fix any \W\ x \U'\ sub-matrix M of JyiilA'). Consider the ec rows of M that contain 
the derivatives oiUi, . . . , UeQ. These rows together contain a total of w := cg ■ elements that 
are up to (q + l)-order derivatives of G; view all the elements of these cg rows as a single vector 
{Asj^G, ■ ■ ■ , As^G) and apply Lemma 14.11 to express it as Vg ■ (Ag^G', • • • , A^^G'). Verify that 
|U^;^var(S'j) I < CG • C£ + \W\ < cg • ci + r^. So, in det(M) we can take Vg common from each of 
these Cg rows such that the elements present inside the determinant are of the form A5.G', where 
G' has at most k{eGCi + r^) children. 

Since \Si\ < Q + 1, at most k{c£ + 1) children of G' depend on var(5'i). If G' is a + gate, then 
A5.G' is the sum of the derivatives of at most k{ci + 1) of its children (that depend on var(5i)). 
If G' is a XX gate computing H^^ ■ ■ ■ H^^ (where t < k{eGCe + r^)), then A5.G' is a polynomial 
combination of the iifj's and {AT-ffjjg /^^c. for each Hj depending on var(5j). Hence in either 
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case, As^G' is a polynomial in the children of G' and their at most (2^'^"'"^ — 1) • k{c£ + 1) many 
derivatives (of order between one and (q + 1)). 

Summing over all the w elements A5.G', the elements of the rows of M are polynomials 
in at most /c(eGQ + n) + w (2^^+^ - 1)/c(q + 1) = /c(eGQ + + ec ■ \U'\ ■ (2^*+^ - + 1) 

derivatives of the children of G'. Going over all G ^ Qu, det(M) can be expressed as a product 
Wcagu^cf and a polynomial y in at most k{riCe + rj) + rj ■ {2"^+'^ -l)k{ce + l) < (q + l)2^*+^/cr/ 
derivatives (of order up to q + 1) of a group of gates in level i + 1. Further, the groups of gates 
whose derivatives constitute the Vg's and V are mutually disjoint (by Lemma l4?T|l . □ 

A. 4 Lower bounds for the immanant 

Lemma 15.11 (restated). Suppose Det„ = C(Ti, . . . , T^), where G is any circuit and let = 
{Ti, . . . , Tr} be a transcendence basis of T with r < n. Then, there exist a set 0/ r + 1 variables 
x,.+i C X and an equation Cifi-Mi = such that Mi 's are distinct first order principal minors 

of M , fi 's are distinct r x r minors of j7xr+i(Tr), not all fi 's are zero, and ci € F*. 

Proof. In a column of a Jacobian matrix c7x(')> all the entries are differentiated with respect to a 
variable we will say that the column is indexed by x. Let = {Ti, • • • , T^.} be a transcendence 
basis of T. Amongst the nonzero r x r minors of i^(Tr) (they exist by Jacobian criterion), pick one 
(call the matrix associated with the minor, A^) that maximizes the number of diagonal variables 
{xii : 1 < z < n} indexing the columns of A^. Let S denote the set of variables indexing the 
columns of A^. Since r < n, there exists a diagonal variable xjj ^ S. Consider the (r + 1) x (r + 1) 
minor of jrx({Det„} U T^) corresponding to the columns indexed by S' := S U {xjj} - call the 
associated (r + 1) x (r + 1) matrix A^. Since, Det„ = C(T), the polynomials Detn and Ti, . . . ,Tr 
are algebraically dependent and hence det(A^) = 0. Expanding det(A^) along the first row of A^, 
which contains signed first order minors (cofactors) of M, we have an equation X]i=i ^ifi^i — 0; 
where Mj's are distinct minors of M, /j's are distinct r x r minors of ^5'(Tr), and Cj G F*. If Mj is 
the principal minor of M with respect to the variable Xjj then fi = det(A^) 7^ (by construction). 

It suffices to show that if Mj is a non-principal minor of M then fi = 0. Consider any non- 
principal minor Mj in the above sum, say it is the minor of M with respect to x^t- The corresponding 
fi is precisely the r x r minor of Js'iT^r) with respect to the columns S'\{xki\ = {S \ {xke})U{xjj}. 
Hence, by the maximality assumption on the number of diagonal elements of M in S, fi = 0- □ 

Lemma l5.2l (restated). If Mi, ■ ■ ■ ,Mt are distinct first order principal minors of M and fi- 
Mi = (not all fi 's are zero) then the total sparsity of the fi 's is at least 2"/-^~*. 

Proof. The proof is by contradiction. The idea is to start with the equation Y2l=i fi^i — 
and apply two steps - sparsity reduction and fanin reduction - alternatively, till we arrive at a 
contradiction in the form of an equation fj ■ Mj = 0, where neither fj nor Mj is zero if the total 
sparsity of the /j's is less than 2"/^~*. With an equation of the form YlJ=i 9i^i = 0; we associate 
four parameters r, 5, r/ and c. These parameters are as follows: r is called the fanin of the equation, 
S is the total sparsity of the giS (we always assume that not all the giS are zero), every Ni is a 
distinct first order principal minor of a symbolic rj x rj matrix A^ = (xij), and c is the maximum 
number of entries of A^ that are set as constants. To begin with, gi = fi and Aj = Mj for all 
l<i<t, so T = t,S = s (the total sparsity of the /j's), r] = n, N = M and c = 0. In the 'sparsity 
reduction' step, we start with an equation J2l=i 9i^i — 0) with parameters r, 5, r/, c and arrive at 
an equation ^l^i g'iN- = with parameters r', <S', ry', c' such that r' < r, <S' < 5/2, rj — 1 < rj' < r], 
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and c' < c + 1. In the 'fanin reduction' step, we start with an equation Yll=i 9i^i — Oi with 
parameters r, 5, r?, c and arrive at an equation Y7i=i9'i^i — with parameters r', <S', r/', c' such 
that one of the two cases happens - Case 1: t' < t — 1, S' < S, r]' = -q — 1, and c' = c; Case 2: 
r' = 1, <S' < 5, 7/' = r/, and c' < c + r. 

Naturahy, starting with Yl\=i fi^i = 0) the 'sparsity reduction' step can only be performed at 
most logs many times (since the total sparsity of the gfj's reduces by at least a factor of half every 
time this step is executed), whereas the 'fanin reduction' step can be performed at most t — 1 times 
(as the fanin goes down by at least one for every such step). Finally, when this process of alternating 
steps ends, we have an equation of the form gi ■ Ni = (Case 2 of the fanin reduction step), where 
Qi and Ni is a principal minor of a symbolic matrix N of dimension at least n — (log s + t — 1) 
such that at most (log s + t) entries of N are set as constants. Now, if log s + t < n — (log s + t) the 
Ni can never be zero (by Fact [3]) and hence we arrive at a contradiction. Therefore, s > 2"'/^~*. 
Now, the details of the sparsity reduction and the fanin reduction steps. 

Suppose, we have an equation X]r=i 9i^i = as mentioned above. Without loss of generality, 
assume that the minor Ni is the minor of N with respect to the i^^ diagonal element of A^. Call all 
the variables Xij in with both i,j>T as the white variables. These are the variables that are 
present in every minor Ni in the sum Y2l=i 9i-^i- "^^^ variables Xij where both i,j < r are called 
the black variables, and the remaining are the grey variables. By assumption, c of the variables in 
N are set as constants. 

Sparsity reduction step - Say x is a white variable that one of the gi^s depends on. Writing 
each gi as a polynomial in x, there must be two distinct powers of x amongst the g'j's (for if not, 
then x can be taken common across all gi^s). Let x^ be the lowest degree and x^ be the highest. 
Dividing the entire equation ^11=191^1 = by x^, we can further assume that £ = 0. Each of 
the gi's and A^j's can be expressed as, gi = gi^ + x ■ gi^i + ■ ■ ■ + x'^ ■ gi^h and Ni = Ni^Q + x ■ Ni^i, 
where gij^s and Nij^s are x-free. Looking at the coefficients of x^ and x^'^^ in the equation yields 
J2J=i 9ifl ' ^i,0 = and J2J=i 9i,h ' = 0- Note that Ni^s can be thought of as principal minors 
of the r] X r] matrix A^' obtained by setting x = in A^. And each of the A^i,i's can be thought of 
as minors of the (r/ — 1) x (ry — 1) matrix A^' which is the matrix associated with the minor of A^ 
with respect to x. Since the monomials in gi^ and x^gi^h are disjoint, either the total sparsity of 
the 5i,o's or the total sparsity of the gi^hS is < 5/2. Thus, one of the equations ^21=1 9ifl ' ^ifl — 
or 'Yl].=i 9i,h ■ -^1,1 = yields an equation of the form Yl'i=i 9i-^i — ^ with parameters r', S', t]', d 
as claimed before. (In case, we choose X^^^^ gi^h ■ = as our next equation, we also set the 
variables in the same columns and rows of x to constants in such a way that a gi^h stays nonzero. 
This is certainly possible over a characteristic zero field |Sch801 Zip79| .) The sparsity reduction 
step is performed whenever the starting equation X]i=i 9i^i = has a white variable among the 
^i's. When all the g'j's are free of white variables, we perform the fanin reduction step. 

Fanin reduction step - When we perform this step, all the gi^s consist of black and grey variables. 
Pick a row R from A^ barring the first r rows. Let yi, • • • ,yT be the grey variables occuring in 
R (these are, respectively, the variables in the first r columns of R). Starting with y2, divide the 
equation YlJ=i9i^i = by the largest power of y2 common across all monomials in the i^j's, and 
then set y2 = 0. This process lets us assume that there exists at least one gi which is not zero at 
2/2 = 0. On the residual equation, repeat the same process with y^ and then with y4 and so on 
till yr. Thus, we can assume without loss of generality that in the equation YlJ=i 9i^i — there 
is at least one gi that is not zero when ?/2) • • • > yr are set to zero. Observe that if gi is the only gi 
that stays nonzero under the projection y2 = . . . = yr = then (ffiA^i)(y2=...=j;^=o) = Oi implying 
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that A'^i = under the same projection - this is Case 2 of the fanin reduction step mentioned 
earher. Now, assume that there is a gi other than gi (say, (72) that is nonzero under the projection 
2/2 = • • • = ?/r = 0. Set ah the remaining variables of row R to zero except yi - these are the 
white variables in R. Since the gi^s are free of white variables (or else, we would have performed 
the 'sparsity reduction' step), none of the gi^s is effected by this projection. However, A^i being 
a minor with respect to the first diagonal element of A^, vanishes completely after the projection. 
Any other Ni takes the form yi ■ N[, where A^^' is a principal minor of a (r/ — 1) x (ry — 1) matrix 
N' which is the matrix associated with the minor of N with respect to yi. Therefore, after the 
projection, the equation YlJ=i9i^i — *-* becomes X]r=2 5« ' Vi-^i = X]I=2 5« ' ~ where gi 
is the image of gi under the above mentioned projection and further g2 7^ 0. The gi^s might still 
contain variables from the first column of N. So, as a final step, set these variables to values so 
that a nonzero gi remains nonzero after this projection (the |Sch801 Zip 79 , IDL78j lemma asserts 



that such values exist in plenty). This gives us the desired form Yll=i9i-^l ~ with parameters 
r', 5', r]' , c' as claimed before (Case 1 of the fanin reduction step mentioned earlier). □ 

Lemma l5.3l (restated) . If Mi, • • • , Mt are distinct first order principal minors of M and 'Yl\=i ctiMi 
= mod ik (not all ai = 0) for independent linear polynomials £k, then t + k > n. 

Proof. Assume that t + k < n (with t > 1 it means k < n — 2). Since ^1, • • • ,ik Eire independent 
linear polynomials, the equation may be rewritten as Y^i=i ctiM- = where {M-)s are minors of 
the matrix M' obtained by replacing k entries of M by linear polynomials in other variables. We 
shall call these entries as corrupted entries. Without loss of generality, we shall assume that M- is 
the minor corresponding to the i-th diagonal variable and that all the Oj's are nonzero. 

Claim A. 3. Each of the first t rows and columns must have a corrupted entry. 

Pf. Suppose the first row (without loss of generality) is free of any corrupted entry. Then, setting 
the entire row to zero would make all M[ = for i ^ 1. But since ^ OiiM[ = 0, this forces M( to 
become zero under the projection as well. This leads to a contradiction as M[ is a determinant of 
an (n — 1) X (n — 1) symbolic matrix under a projection, and this can not be zero unless > n — 1 
(by Fact [3|) . □ (ciaim) 

Since n — k > t, there must exist a set of t — 1 rows • • • , Rt-i} of M that are free of any 
corrupted entries. For each of these rows, set the i-th variable of row Ri to 1, and every other 
variable in iZi, • • • , Rt-i to zero. These projections make M- = for all i ^ t (as in these minors 
an entire row vanishes). And since X]i=i onM- = 0, this forces M/ to become zero under this 
projection as well. But under this projection, Af/ just reduces (up to a sign) to the minor obtained 
from M' by removing the columns {1, • • • ,t} and rows • • • , -Rt_i} U {t}. This is a determinant 
of an (n — t) x (n — t) symbolic matrix, containing at most k — t corrupted entries, thus k — t > n — t 
(by Fact [3]). But then k > n, which contradicts our initial assumption. □ 

A. 5 Extensions to immanants 

All the lower bound proofs use some very basic properties of Det„. These properties are general 
enough that they apply to any immanant. For any character x : ^ C^, recall the definition of 
the immanant of an n x n matrix M = (xij): 

n 

Imm^(M) = ^ x{(^)Y[xi^„(^i) 
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Since x is a character, this in particular means that xi^) ^i^Y <^ ^ Sn 

Definition 5 (Immanant minor). The minor of Imm^{M) with respect to the {i,j)-th entry is 
defined as 

[Imm^iM))^ . = ^ n 
o-(«)=i 

This may also be rewritten as a scalar multiple of Imm^/(Mjj) for a suitable character x' : 
Sn-i C^, where Mjj is the submatrix of M after removing the i-ih row and j-th column. From 
the definition, it follows directly that the partial derivative of Immj^(M) with respect to xij is 
precisely the minor with respect to j). 

The only crucial fact of determinants that is used in all the proofs is that a symbolic n x n 
determinant cannot be zero when less than n of its entries are altered. 

Fact 3. Let M' he the matrix obtained by setting c < n entries of M to arbitrary polynomials in 
F[x]. Then for any character x '■ Sn ^ , we have Imm^{M') ^ 0. 

Proof. We shall say an entry of M' is corrupted if it is one of the c entries of M that has been 
replaced by a polynomial. We shall prove this by carefully rearranging the rows and columns so 
that all the corrupted entries are above the diagonal. Then, since all entries below the diagonal are 
free, we may set all of them to zero and the immanant reduces to a single nonzero monomial. 

Since less than n entries of M' have been altered, there exists a column that is free of any 
corrupted entries. By relabelling the columns if necessary, let the first column be free of any 
corrupted entry. Pick any row R that contains a corruption and relabel the rows to make this the 
first row. This ensures that the first column is free of any corrupted entry, and the (n — 1) x (n — 1) 
matrix defined by rows and columns, 2 through n, contain less than c— 1 corruptions. By induction, 
the c — 1 corruptions may be moved above the diagonal by suitable row/column relabelling. And 
since the first column is untouched during the process, we now have all c corruptions above the 
diagonal. Now setting all entries below the diagonal to zeroes reduces the immanant to a single 
nonzero monomial. □ 

With this fact, all our lower bound proofs of the determinant can be rewritten for any immanant. 

B Conditional immanant lower bounds for depth-D occur-A; for- 
mulas 

In this section, we present a lower bound for depth-D occur-fc formulas similar in spirit to Theo- 
rem 11.41 by assuming the following conjecture about determinant minors. 

Conjecture B.l. Let M = (xij) be an n x n matrix, and let Xi denote the i-th diagonal variable 
Xii. Let M' be a projection of M by setting c = o{n) of the variables in M to constants. Suppose 
the elements xi,--- ,Xk, where k is a constant independent of n, are partitioned into non-empty 
sets Si,-- - ,St. Consider Ai{St), the set of t*"^ order principal minors of M' , each by choosing a 
t-tuple B £ Si X - - - X St as pivots. Over all possible choices of B, we get m := l^il • • • \St\ many 
minors. Then for any set of diagonal variables ym disjoint from Xk, Jy^ {M.{St)) / 0. 



21 



The conjecture roughly states that the different -order principal minors are algebraically 
independent. We will need a generalization of Lemma l5. II for the purposes of this section. 

Lemma B.2. Suppose {/i,--- ,fs,gi,-'' y9t} o-'^^ algebraically dependent polynomials such that 
trdegjgt} = t. Let S x be a fixed set of variables of size at least s + t. Then there exists a set 
of s + t variables Xg+t C x and an equation of the form 

r 

Ci ■ Fi ■ Gi = where r < 

i=l 

such that each Ci € F*, each Fi is a distinct s x s minor of J'^^^^f^si^s), each Gi is a distinct t x t 
minor of Jx^+tiSt), CLnd not all Gi 's are zero. 

Note that we are not asserting the nonzeroness of Fj's. Also, Lemma lS.ll may be obtained from the 
above lemma by taking fi = Det„, s = 1 and S to be the set of diagonal variables. 

Proof. The proof is along the lines of Lemma l5.ll Amongst the nonzero t x t minors of JT^igt), 
pick one (call the matrix associated with the minor, N) that maximizes the number of variables in 
S indexing the columns of N. Without loss of generality, let x^ be the set of variables indexing the 
columns of A^. Since |5| > s + 1, there exists s other variables in S, say {xi+t, ■ ■ ■ i Xg+t}- Consider 
the (s + t) X (s + t) minor of J^x,{¥s U gt) corresponding to the columns indexed by x^+t - call the 
associated {s + t) x (s + t) matrix A^. 

Since f<i,gi are algebraically dependent, we have that det(A^) = 0. Expanding det(iV) over all 
possible s X s minors in the first s rows, we have an equation 

^ Ci-Fu-Gu = 

C/Cx,+t,|C/|=s 

where each Fjj is a distinct sxs minor of ^x^+t (fs) i each Gjj is a distinct txt minor of ^Jx^+t (gt) , and 
Ci € F*. If Gjj is the minor with respect to variables x^, then Gu = det(A^) ^ (by construction). 
It suffices to show that if Fu is a minor indexed by variables outside S, then Gjj = 0. This follows, 
just like in Lemma l5.1|, by the maximality assumption on choice of x^. □ 

The rest of this section shall be devoted to the proof of the following theorem. 

Theorem B.3. Assuming Conjecture \B.l[ any depth-D occur-k formula that computes Detn must 
have size s over any field of characteristic zero. 

Proof idea: The proof proceeds on the same lines as Theorem ll.4l If Ti , • • • , is a transcendence 
basis of gates at level 2 computing the determinant, then ^^{Detn, , T^) is a matrix of rank k. 

This yields a non-trivial equation of the form ^ N^^^ 'G\^^ = where each of the N^^^ 's are principal 
minors of M = {xij) and G^^^'s are k x k minors of J^x{Ti, ■ ■ ■ ,Tj^). Here is where we may use 
Lemma [4.2l to remove common factors and obtain an equation of the form ^ N^^^ ■ g/^'' = where 
g/^^ is a polynomial of constantly many derivatives of polynomials computed at the next level. 
The above equation may be thought of as a polynomial relation amongst |a^^^^| U |Elem(G/^'')|. 

Applying Lemma lB.21 (with a suitable choice of 52), we get an equation of the form ^ A^j -G- = 
where each A^^^^ is a minor of J's2 (\^i^^\\ and G-^^s are Jacobians minors of |J Elem(G/^^). 
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Again after removing common factors, this equation may be intepreted as a polynomial relation 

(2) ~ (2) 

amongst the entries of A'^ (which are minors of order 2) and Elem(Gi ). 

Repeating this argument, we finally reach the level of sparse polynomials and obtain a non- 
trivial equation ^ N^^ • = 0, where each N^^ is a Jacobian minor of {D — 3)-order 
minors, and each is a sparse polynomial. With a slightly more careful choice of the sets Si 
in Lemma [B. 21 each of the minors iV^^"^^ would be a minor of J5^_2(7W(5i, • • • ^Sd-s))- Assuming 
Conjecture IB. H we can show that such an equation is not possible unless the sparsity of the /j's is 
large, using a similar argument as in Lemma [ 



Lemma B.4. Suppose Detn is computed by a depth-D occur-k formula of size s. Then there 
exist variables xi, - ■ ■ , x^i where R = R{k, D), a partition of xjj into non-empty sets Si, - ■ ■ , Sd', 
(D' < (D — 2)) polynomials fi,--- , fm (not all zero) where m = \M{Sd)\^^^^ and each fi has 
sparsity at most s^, such that 

m 

1=1 

where each Ni is a minor of JTx{Ai{S£)')) indexed by diagonal variables. 

Proof. To begin with, Det^ = C{Ti, ■ ■ ■ ,Tm) where Ti, • • • ,Tm are polynomials computed at the 
first level. So Lemma l5. II gives a starting equation, though we do not really have a sparsity bound 
on the fiS. The proof shall proceed by transforming this equation into another, involving lower 
level polynomials, till we get a sparsity bound. 

In general, we shall have an equation of the form Ci{M{Si, • • • , S£^i),t[^\ ■ ■ ■ , Tr^^) = 0, where 
each Tj^^^ is a derivative (of order at most £) of a polynomial computed at level £ of the circuit. 
Without loss of generality, we may assume that |r^^^\ • • • , TrP^ are algebraically independent. Let 

nii := \Si\ - ■ ■ \Si-i\. Choose a set of diagonal elements Si of size \A4{Si, ■ ■ ■ , S£-i)\ + r^ that is 
disjoint from Si, - ■ ■ , Si-i. Applying Lemma IB . 21 with Si, we get an equation of the form 

i 

where N-^^ is an m£ x minor of iJsii-^i^e-i)) indexed by diagonal variables, each cf^ is an 
r£ X ri minor of J's^Cri^^). Since C is an occur-A; circuit, using an argument similar to Lemma 14.2^ 
the above equation may be rewritten as 

i 

where each g/^^'s is a polynomial function of at most r^+i := {£ + 1)2^+^ • k{r£ + m()ri many 
derivatives of polynomials computed at level £ + 1. Note that cannot be zero as at least one G^ 
was guaranteed to be nonzero by LemmaEa Therefore, Y.i cf^N^-Gi = 0. Since each G,- is a 
polynomial function of r^+i derivatives at the next level, we now have G^+i {A4 {Si, - - - , 5'^ ) , T^^'^^'^ ,■■ ■ 
T^n^) = 0. 

Unfolding this recursion, we finally reach the level of sparse polynomials, at which point we 
have an equation of the form 

{D-2)^j{D-2) ^.(^-2) 



-^^ =0 
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and each Gi is a ro^2 x '''D-2 Jacobian minor of sparse polynomials. Hence, each Gi is 
itself a polynomial of sparsity bounded by s^^-'^ as claimed. □ 

We now have to show that an equation of the form Yl fi' = is not possible unless one of the 
/j's has exponential sparsity. The above lemma guarantees that at least one of the /j's are nonzero 
in this equation, but it could be the case that some of the A^j's are zero. This was not the case in 
the depth-4 lower bound as each A^, was just a determinant minor. However, in this case they are 
jacobians of minors. Conjecture IB . 1 1 asserts that the A'j's are nonzero, even ii few variables are set 
to zero. This assumption would be enough to get the required lower bound. 

Lemma B.5. Let \Ai(Si, ■ ■ ■ ,Sd)\ =: m he a constant and let {iVj}j<j he distinct mxm minors 
of J^^{M{Sd)) where the columns of Ni are indexed hy a set Ti of diagonal variahles of M disjoint 
from [jf=i Sj. Suppose /i, • • • , ft are polynomials such that J2l=i fi' = ^ M fi 's are zero). 
Then, assuming Conjecture \B.1\ is true, the total sparsity of the fi 's is 2^^"'^ . 

Proof. The proof is along the lines of the proof of Lemma 15.21 and shall proceed by a similar series 
of sparsity reduction and fanin reduction steps to arrive at a contradiction. Throughout the proof. 
Conjecture IB. II shall assert that Ni's stay nonzero (even when few variables are set to constants). 
We briefly describe the sparsity reduction and the fanin reduction steps and the rest of the proof 
would follow in essentially an identical fashion as the proof of Lemma 15.21 

Without loss of generality, assume that {xi, • • • ,Xr} is the union of the sets 5j's and Tj's. Let 
refer to the matrix of indeterminates that the A'j's are derived from. In our case, N would 
be obtained by (possibly) setting few variables to constants in M = (xij). We'll refer to all the 
variables Xij where both i,j > r as white variables; these are present in every entry of each N^. The 
variables Xij where both i,j <r shall be called hlack variables, and the rest called grey variables. 
Here again, the sparsity reduction step shall be applied whenever one of the /j's depends on a white 
variable, otherwise the fanin reduction steps shall be applied. 

Sparsity-reduction step - Suppose one of the /j's depend on a white variable x. Then each Ni 
can be written as Ni = Ni^ + • • • + x^Ni^m, and fi = fi^ + ■ ■ ■ + fi^hX^- One of the two equations 
corresponding to the coefficient of x^ and x^~^"^ yields a similar equation with sparsity reduced by a 
factor of 1/2. Observe that Ni^Q is just Ni |x=0) and hence the polynomials {Ni^o} may be thought 
of as corresponding Jacobian minors of A'^' obtained by setting x = in A^'. Also, Ni^m is obtained 
by replacing every entry of the matrix corresponding to Ni by its minor with respect x. And hence, 
Ni,m can be thought of as a corresponding Jacobian minor of A^^^ obtained by taking the minor of 
A^ with respect to x. Thus the two equations corresponding to the coefficient of x^ and x^~^^ are 
indeed of the same form as fiNi = 0. (In the case of the coefficient of x^"^*", we need to set 
other variables in the row/column containing x as in the proof of Lemma l5.2p 

Fanin reduction step - Without loss of generality, let xi G Ti\T2. Pick a row R of N barring 
the first r rows, and let yi, • • • ,yr be the grey variables in R (where yi is in the same column as xi). 
By a similar process as in the proof of Lemma 15.21 we can assume that at least one fi is nonzero 
when y2> ■ ■ ■ ^Ur are set to zero. 

If one of the /j's become zero when y2, - ' ' > yr = 0, then pick any white variable y in row R and 
set every variable in row R to zero besides y. This would ensure that the fanin of the equation 
reduces and each A'j is now • A^^'. Each A^^' may be thought of as being obtained from Ny, the 
minor of A^ with respect to y. The other variables in the column of y can be set to values to ensure 
that the /j's stay nonzero to obtain an equation of the form ^ fi^'i = of reduced fanin. 
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If none of the /j's become zero when y2, - ' ' ; = 0, then set every variable in row R other than 
yi to zero. This ensures an entire column of the matrix corresponding to A'^i becomes zero (as xi 
indexes one of the columns of A'^i), and hence A^i becomes zero. On the other hand, A''2 remains 
nonzero and each surviving Ni can be written as ■ where A^^- is the corresponding Jacobian 
minor of -/Vy^- Again, the other variables in the column of yi can be set to values to ensure that 
/j's stay nonzero and we obtain an equation ^ fiN- = of reduced fanin. 

As in the proof of Lemma 15.21 we eventually obtain an equation of the form fiNi = where 
/i 7^ thus implying that A^i = 0. The number of variables that have been set to constants is 
bounded by t + logS" where S is the initial total sparsity of the /j's, and A^i is a Jacobian minor 
of a symbolic matrix of dimension n — (logS" + t — 1). Conjecture IB. II asserts that A'^i would be 
nonzero unless log 5 + t = n{n - (log S + t- 1)), or S = 2^("). □ 

That concludes the proof of Theorem IB. 31 as well. 
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